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Abstract 

Undergraduate teaching evaluation plays an important role 
in promoting the educational management and improving 
the teaching quality in colleges and universities. In this 
paper, considering the uncertainty and fuzziness in 
undergraduate teaching evaluation, we translate the 
problem of undergraduate teaching evaluation into a hybrid 
multi-attribute decision making with hybrid data which the 
attribute values integrate with real numbers, interval 
numbers and fuzzy numbers. To evaluate and rank the 
undergraduate teaching level for multiple alternative 
universities, we propose a novel optimization decision 
method based on grey relational analysis. Moreover, an 
application decision making example is given to highlight 
the implementation, availability, and feasibility of this 
optimization decision method. 
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Introduction 

In the 21st century, with the rapid progress in 
economic globalization and science and technology, 
the comprehensive national strength competition is 
increasingly fierce. To vigorously improve school- 
running level, the teaching quality of universities has 
become the theme of the times, and also has become 
the urgent task of higher education reform and 
development. Undergraduate education is the basis 
and the main body of higher education and the 
undergraduate teaching is the key to improve the 
quality of the whole higher education. 

Sincel994, the Ministry of Education of China has 
organized the undergraduate teaching evaluation for 
the colleges and universities. By the end of 2004, a 
total of 350 colleges and universities had accepted the 
undergraduate teaching evaluation. This evaluation 


plays an important role in promoting the educational 
management and improving the teaching quality in 
colleges and universities. This effect is reflected in two 
basic aspects. The first one is to promote the 
construction of the colleges and universities effectively. 
The second is to enhance the school's self-discipline 
consciousness and self-discipline effectively. The most 
direct effect of undergraduate teaching evaluation is to 
promote the construction of schools, and let the 
schools focus on increasing investment and improve 
the teaching conditions. Also, it makes further clear 
guiding ideology of running school, improves the 
level of management, strengthens the construction of 
teaching staff and promotes the reform of teaching. In 
a word, it has played a very important role in the 
improvement of teaching, talent training and 
education quality (Stronge, 2006). 

Generally, in the practical undergraduate teaching 
evaluation, the expert group often gives a score for 
each evaluation attribute for all alternative universities, 
and then uses the weighted average method to give a 
comprehensive score of teaching level for each 
university. This method is simple, but it has some 
problems (Wei, 2012), for example, due to the 
restrictions of profession and experience, the score 
which is given by the experts in the form of real 
number has a certain subjective randomness, and 
sometimes the comprehensive evaluation results are 
unfair. The evaluation workload is great, but the 
evaluation results must be given in a short time, thus it 
will affect the objectivity and the accuracy of 
evaluation results in some extent. 

Undergraduate teaching evaluation is a complex 
system which involves with multiple attributes. In 
August 2004, the ministry of education of China 
issued the "Evaluation scheme of undergraduate 
teaching evaluation". In this scheme, seven first-class 
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attributes are given to evaluate the undergraduate 
teaching level, i.e., university guiding ideology, 
teaching staff, teaching conditions, specialty 

construction and teaching reform, teaching 

management, study style, and teaching effect. These 
first-class attributes include 19 sub-attributes, i.e., the 
university orientation, educational ideas, the teachers' 
number and structure, the quantity of master teacher, 
the basic facilities for teaching, teaching funds, 
specialty, curriculum, teaching practice, the 
management team, teaching quality control, the 
teacher demeanor, learning culture, basic theory and 
basic skills, graduation thesis or graduation design, 
the ideological and political moral culture, sports, 
social reputation and employment. When we use these 
attributes to evaluate a university's teaching level, 
there are a lot of fuzziness and uncertainty in the 
evaluation process. As in the 19 sub-attributes, the 
values of some qualitative attributes such as university 
orientation and educational ideas are often given in 
the form of linguistic fuzzy variables, such as "worst, 
worse, bad, common, good, better, best" or "lowest, 
lower, low, common, high, higher, highest "(Xu, 2004; 
Rao and Peng, 2009; Rao and Zhao, 2009). And the 
values of the quantity of master teacher and the 
percent of doctorates in all teachers often can be 
determined by real numbers. In addition, for some 
special attributes, such as teaching funds, the value 
can not be given by a real number because of the 
overlapping inputs for many kinds of funds using, 
and can only be given by a value range, i.e., interval 
number. Thus, in the undergraduate teaching 
evaluation, the precise values, interval numbers and 
the linguistic fuzzy variables coexist simultaneously 
(Rao and Peng, 2009; Xu, 1999). Considering this 
hybrid data information, we translate the problem of 
undergraduate teaching evaluation into a hybrid 
multi-attribute decision making with hybrid data 
which the values of attributes integrate with real 
numbers, interval numbers and fuzzy numbers, and 
propose a novel optimization decision method based 
on grey relational analysis to rank the teaching level 
for all alternative universities. We try to provide a new 
quantitative method for undergraduate teaching 
evaluation under uncertain information environment. 

The rest of the paper is organized as follows. Section 2 
proposes a novel optimization decision method based 
on grey relational analysis to rank the teaching level 
for all alternative universities. Section 3 gives the 
decision making process description. Section 4 
presents a numerical application example to show the 


feasibility of the proposed decision method. Section 5 
concludes the paper. 

Decision Making Method 

The problem of undergraduate teaching evaluation 
can be described as the following hybrid multi- 
attribute decision making with hybrid data. We 
suppose that an expert group wants to evaluate the 
teaching level for m alternative universities, n 
evaluation attributes such as university orientation, 
educational ideas, the teachers' number and structure, 
etc. form the evaluation system. The attribute set is 
denoted as P = {p v p 2 ,L ,p n ] . W = (vq, w 2 ,L ,w n ) is 
the weight vector of attributes such that 0<w,.<l 
and I’ The original hybrid decision making 

matrix is denoted as A = , where a lj is the 

attribute value of alternative x t ( i = 1, 2,L , m ) on 
attribute pj , j= 1,2, . . ,,n. We denote: 

N = {1, 2,L ,n } , N t = {1, 2,L ,n x } , 

N 1 = [n { +l,«j +2,L ,«->} , N 3 = {n 2 + l,n 2 +2,L ,n } , 

where N l ,N 2 ,N 3 denote the sets of three kinds of 
attributes with real numbers, linguistic fuzzy variables, 
interval numbers, respectively. When j e iV, , a (/ e R is 

a real number. When j e N -, , a ( j are interval numbers 
< 2 (/ = ] . When j e N 3 , a tJ is a linguistic fuzzy 

variable. All values of a ~ are formed an original 
hybrid decision making matrix A = (a^) mxn . Now we 

need to make evaluation and rank the teaching level of 
all alternative universities. 

Data Processing 

In hybrid multi- attribute decision making, when some 
attribute values are given in the form of linguistic 
fuzzy variables, we can transform them into triangle 
fuzzy numbers. The transfer method is given as 
follows. 

Definition 1. Suppose that S a ={worst, worse, bad, 
common, good, better, best} or S b =|lowest, lower, low, 
common, high, higher, highest}, then S a and S b are 
called the set of linguistic fuzzy numbers, they are 
denoted as S a = { q , s 2 ,L , s 7 } , S h = { s x , s 2 ,L , s 7 } , and 
their corresponding triangle fuzzy numbers are 
defined as follows. For the type of revenue attributes, 
we denote 

Sj =(0,0,0. 1); s 2 = (0,0. 1,0.2); ^ =(0.2,03,0.4); 
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s 4 =(0.4,0.5,0.6); s 5 =(0.6,0.7,0.8); s 6 =(0.8,0.9,1); 
s,= (0.9,14). 

For the type of cost attributes, we denote 

s l =(0.9,1,1); s 2 =(0.8,0.9,l); s 3 =(0.6,07,0.8); 
s 4 =(0.4,0.5,0.6); s 5 =(0.2,03,0.4); s 6 =(0,0.1,0.2); 
s 7 =(0,0,0. 1), 

the corresponding triangle fuzzy numbers for S b are 
the same as S a . 

When the values of attribute j e N 3 are all 
transformed into triangle fuzzy numbers, a new 
hybrid decision making matrix can be obtained, it is 
denoted as X = (x tJ ) mxn . 

We denote the benefit type attribute as /, , and denote 
the cost type attribute as I 2 , and M ={1,2, 
L ,m},N = { 1, 2,L ,n} . The algorithms of normalizing 
the real numbers, interval numbers and triangular 
fuzzy numbers refer to Xu (1999, 2004), Xiao et al. 
(2005). Suppose the matrix X is transformed into 
normalized matrix Y = (>’ y ) mx „ , where 

y v = y v > 'eM.yeiV,; 

Yu =[/. /L isM,jsN 2 ; 

y, - | y / .y' , .y r ]./c. \/../c A\ . 


Grey Relational Analysis Method of Hybrid Sequences 

In this section, we give an algorithm based on grey 
relational degree to deal with the problem of 
undergraduate teaching evaluation. Firstly, some 
definitions are given. 

Definition 2. Suppose a i = [a{\af ,a'{ ] , a 1 =\a^,a I f, 
of ] are two triangle fuzzy numbers, then the 
Hausdorff distance between a t and a 2 are defined: 

\ r| L L\ I M Ml I V JjU 

, (^ 2 ) — max | i l^i ^2 ’ ^2 1 1 * 

Definition 3. Suppose a,=[af,af], a 2 =[a 2 ,a 2 ] are 
two positive interval numbers, then the distance 
between these two interval numbers are defined: 

n , x V2 /, L L\2 , , U U \2 

D(a l ,a 2 ) = — — y(a, -a 2 ) +(< 3 ^ -a 2 ) . 

Definition 4. Let a = (a(l),«(2),L ,a(n)) be an n- 
dimensional data sequence. If the real numbers, 
interval numbers and triangular fuzzy numbers are 
coexistent in the values of «(1), a(2),L ,a{ri) , then a 


is called a hybrid sequence. 

For the hybrid decision making matrix Y = (}=■ ) mx „ , the 
elements of each row constitute a hybrid sequence y ; , 
where 


h =(ynAi2’ L 7 i , v [yt 1+ i’A + i]- L fyt 2 ^cn 2 l 


(i) 


Definition 5. Let Y = (y,j) mxn be a hybrid making 
matrix, then 

/=(/l./ 2 .L ,/„) 

= (max y,., , max y j2 ,L , max y t „ , [max y L , max y u ], 

1 <i<m ' 1 <i<m 1 <i<m ' ' 1 l<i<m ' l<i<m ' ' ”i« 

L , [max y[ , max yf ],[max )f +l , max max bf +] ], 

l<t<m l<t<m l<i<m l<t<m - l<t<m 


L , [max y in , max y in ,max y,„ ]) 

!</<m l<t<m l<j<m 


is called positive ideal solution. 


( 2 ) 


Based on Definitions 2-5, the following Definition 6 
defines grey relational degree of hybrid sequences. 

Definition 6. Suppose yi,y 2 ,L ,y m are hybrid 
attribute sequences, y 0 = / is reference sequence, y, 
are compared sequences, i = 1, 2,L , m , where / and 
y ( . are expressed by (2) and (1), respectively. Then the 
grey relational coefficient of hybrid attribute 
sequences is defined: 




p max max A(/ , y tj ) 
' i 

Mf, , ) + p max max A (A , y .. ) ' 


(3) 


The grey relational degree of hybrid attribute 
sequences is defined: 


K%.h)= Zw ; .r(/,,y,), 


7=1 


(4) 


Where A(/ /5 )y ) is the difference information at the y- 
th point of y, to / . When y e N y , 


A(/,,y,) = 


maxy y -y 0 

l<t<m 7 7 


When j e N 2 , 


= T -. v b 5 + -y? ) ! ; 

When j e N 3 , 

A (fj,y ij ) = D H (f j ,y ij ) 


L L 


M M 



max^-^ 

l<t<m 

• 

maxy.. -y.. 

l<i<m 

• 

maxy.. -y.. 

l<t<m 7 7 
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p is the distinguishing coefficient, generally, we set 
p = 0.5 ; Wj is the weight of the y'-th attribute pj , 
j = 1, 2,L , n . 

The Decision Making Process Description 

In this section, we give the detail steps for evaluating 
and ranking the teaching level of all alternative 
universities. 

Step 1: The expert group determines the original 
hybrid decision making matrix A = (a y . ) mxn , where a :j 

is the attribute value of alternative x t ( i = 1,2,L , m) on 
attribute p (j = l,2,L ,n). 

Step 2: Use Definition 1 to transform linguistic fuzzy 
variables into triangle fuzzy numbers, then a new 
hybrid decision making matrix X = (x :j ) m/n is 

obtained. 

Step 3: Normalize the real numbers, interval numbers 
and triangular fuzzy numbers refer to Xu (2004), then 
we get the normalized matrix Y = (}y) mx „ , where 

Yij = Yij . ieM.jeNp, y {j = [/, /], i e M, j e N 2 ; 

.v, 7 -|.v / .y''.y r ]./c.\/../c A ? . . 

Step 4: Use (2) to determine the positive ideal solution, 
i.e., reference sequence. 

Step 5: Use (3) and (4) to compute the grey relational 
degree r(y 0 ,y t ). 

Step 6: Rank the teahing level of all the alternative 
universities in accordance with r(y 0 ,y i ) . 

An Application Example 

Here let us suppose that a expert group wants to 
evaluate the teaching level of four alternative 
universities (U i, Lh, lb, Ui) by considering the 
following five attributes, i.e., the percent of doctorates 
in all teachers ( p t ) (%), the quantity of master teacher 
with senior professional post ( p 2 ), teaching funds 
( p 3 )(10 4 Yuan), teaching quality control (p 4 ), learning 
culture ( p 5 ). The data information are listed in Table 1. 
Let the vector of attribute weights be W=(0.25, 0.15, 0.15, 


TABLE 1 ORIGINAL DECISION MATRIX 


University 

pi 

P2 

P3 

P4 

ps 

Ui 

19 

480 

[50, 60] 

high 

good 

Ui 

24 

530 

[35, 45] 

low 

common 

Us 

17 

490 

[55, 65] 

good 

better 

114 

21 

500 

[40, 50] 

common 

common 


0. 15, 0.2). Our task is to evaluate the teaching level of 
four alternative universities according the given 
information in Table 1. 

(1) Transform the linguistic fuzzy variables into 
triangle fuzzy numbers, and normalize the data, and 
then use (2) to determine the positive ideal solution, 

1. e., reference sequence 

/ = (1,1, [0.462, 0.836], (0.492, 0.698, 0.990), 
(0.533,0.688,0.893)). 

(2) Using (3) and (4) to compute the grey relational 
degree r(y 0 ,y ; ), i=l, 2, 3, 4, 

r(y o, >’i ) = 0.732 ; r(y 0 , y 2 ) = 0.580 ; 
r(y 0 , y 3 ) = 0- 822 ; r(y 0 , y 4 ) = 0.597 . 

(3) Rank the teahing level of all the alternative 
universities in accordance with r(y 0 , y : ) . 

Because r(y 0 ,y 2 )> r(y 0 ,y x )> r(y 0 ,y^)> r(y 0 ,y 2 ) , then 
the teaching level of four alternative universities are 
ranked as follows: U 3 f [/, f U 4 f U 2 . 

Conclusions 

In this paper, we propose an optimization decision 
method based on grey relational degree of hybrid 
sequences to evaluate the undergraduate teaching 
level of universities. There are several valuable work 
in this paper, i.e., the new definition of hybrid 
sequence is given, and the grey relational degree of 
hybrid sequences is presented based on Professor 
Deng' grey relational analysis method. Therefore, it 
provides an effective way to deal with the problems of 
hybrid multi-attribute decision making. 
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